Apparatus and method for processing an image in device

ABSTRACT

A method of processing an image using an electronic device is provided. The method includes displaying at least part of a first image which is obtained through a first image sensor and at least part of a second image which is obtained through a second image sensor through a display unit which is functionally connected to the electronic device, storing the at least part of the first image, storing the at least part of the second image in response to a detecting of a signal, and storing the at least part of the first image and the at least part of the second image to be simultaneously replayed as at least one image.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior application Ser.No. 14/174,234, filed on Feb. 6, 2014, which claimed the benefit under35 U.S.C § 119(a) of a Korean patent application filed on Feb. 26, 2013in the Korean Intellectual Property Office and assigned Ser. No.10-2013-0020599, the entire disclosure of each of which is herebyincorporated by reference.

TECHNICAL FIELD

The present disclosure relates to a method and apparatus forphotographing an image. More particularly, the present disclosurerelates to an apparatus and method for photographing a plurality ofimages, which are detected by at least one image sensor, by using anelectronic device such as a smartphone.

BACKGROUND

Generally, a method of photographing an image in a camera devicedisplays image data, which is obtained from the image sensor of eachcamera, on a display unit, and compresses and encodes obtained imagedata and stores the image data in a memory if a user gives a command totake a photograph.

An existing camera device or a portable terminal equipped with a cameramay include a plurality of cameras, including high pixel cameras or lowpixel cameras. The plurality of cameras are mounted on a front side anda rear side of the camera device or the portable terminal. Further, thecamera device or the portable terminal including the plurality ofcameras, that is, dual cameras, may photograph a front side subject or arear side subject by independently selecting the front camera and therear camera. That is, the camera device or the portable terminalincluding a plurality of cameras may respectively photograph differentimages, and separately store and manage photographed images.

Further, the camera device or the portable terminal including aplurality of cameras may obtain a plurality of images by operating aplurality of cameras, and compose and store the obtained images byPicture In Picture (PIP) type. Currently, when a plurality of camerasare simultaneously driven, it is difficult to obtain a plurality ofnatural images. That is, in the photographic mode, the user performs aphotographic operation by checking images outputted from the front sideor rear side camera, and thus it is difficult to simultaneously checkand photograph images which are outputted from a plurality of cameras.Hence, images, which are photographed from respective image sensors, maybe photographed in a desired form by controlling respective imagessensors in a device including a plurality of image sensors.

Accordingly there is a need for an apparatus and method capable ofcapturing images while consecutively controlling image sensors by usinga timer when a photographic operation is requested in an electronicdevice equipped with a plurality of image sensors.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide an apparatus and method for enhancing userconvenience when photographing a plurality of images by using at leastone image sensor.

Another aspect of the present disclosure is to provide an apparatus andmethod capable of photographing a plurality of images while controllinga plurality of image sensors.

Another aspect of the present disclosure is to provide an apparatus andmethod capable of capturing images while consecutively controlling imagesensors by using a timer when a photographic operation is requested inan electronic device equipped with a plurality of image sensors.

Another aspect of the present disclosure is to provide an apparatus andmethod capable of capturing images while controlling image sensors byperforming a first photographic operation when a photographic operationis requested in an electronic device equipped with a plurality of imagesensors and performing the photographic operation by operating a timerwhen a certain action is sensed.

In accordance with an aspect of the present disclosure, a method ofprocessing an image using an electronic device is provided. The methodincludes displaying at least part of a first image which is obtainedthrough a first image sensor and at least part of a second image whichis obtained through a second image sensor through a display unit whichis functionally connected to the electronic device, storing the at leastpart of the first image, storing the at least part of the second imagein response to a detecting of a signal, and storing the at least part ofthe first image and the at least part of the second image to besimultaneously replayed as at least one image.

In accordance with another aspect of the present disclosure, a method ofprocessing an image using an electronic apparatus is provided. Themethod includes displaying at least part of a first image which isobtained through a first image sensor and at least part of a secondimage which is obtained through a second image sensor through a displayunit which is functionally connected to the electronic device, storingthe at least part of the first image, storing the at least part of thesecond image after a second time period elapses if a signal is sensed,storing the at least part of the second image if the signal is notsensed within a first time period from the storing of the at least partof the first image, and simultaneously replaying the at least part ofthe first image and the at least part of the second image as at leastone image.

In accordance with another aspect of the present disclosure, anelectronic device is provided. The electronic device includes a storageunit configured to store image information, and a controller configuredto process the image information, wherein the controller is configuredto display at least part of a first image, which is obtained through afirst image sensor, and a part of a second image, which is obtainedthrough a second image sensor, through a display unit which isfunctionally connected to the electronic device, to store the at leastpart of the first image, to store the at least part of the second imagein response of a detecting of a signal, and to simultaneously replay theat least part of the first image and the at least part of the secondimage as one image.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 illustrates a configuration of an electronic device according toan embodiment of the present disclosure;

FIGS. 2A, 2B, and 2C illustrate a procedure of displaying andphotographing a dual image in an electronic device equipped with a dualimage sensor according to an embodiment of the present disclosure;

FIG. 3 is a flowchart illustrating a procedure of photographing imagesin an electronic device equipped with a dual image sensor according toan embodiment of the present disclosure;

FIG. 4 is a flowchart illustrating a procedure of performing a previewmode in a dual mode according to an embodiment of the presentdisclosure;

FIG. 5 is a flowchart illustrating an example of photographing a dualimage in an electronic device equipped with a dual image sensoraccording to an embodiment of the present disclosure;

FIG. 6 illustrates a procedure of photographing a dual image as in FIG.5 according to an embodiment of the present disclosure;

FIG. 7 is a flowchart illustrating a procedure of sequentiallyphotographing a dual image in an electronic device equipped with a dualimage sensor according to another embodiment of the present disclosure;and

FIG. 8 illustrates a configuration of a portable terminal which performsa photographic operation according to an embodiment of the presentdisclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

A camera device or a portable terminal equipped with a camera mayinclude a plurality of cameras, display images obtained from a pluralityof cameras in a preview mode on one screen in the form of a main screenand a sub-screen, or display the main screen and the sub-screen on thedisplay unit in a parallel form. Likewise, if a photographic operationis requested in a state in which a preview image is displayed asdescribed above, a device equipped with a camera according to anembodiment of the present disclosure may first capture the main screenimage and the sub-screen image, compose the captured main-screen andsub-screen images, and store the composed images. In the descriptionbelow, a camera device or a device equipped with a camera will bedescribed as an electronic device, and the electronic device may includea smart phone, a tablet computer, and a device including a cameradevice, etc. Further, the electronic device may be a device includingtwo or more image sensors.

In a method of photographing the main screen image and the sub-screenimage according to one embodiment of the present disclosure, theelectronic device may capture the main screen image which is outputtedfrom the image sensor which generates the main screen image when aphotographic operation is requested, and display the sub-screen image,which is outputted from the image sensor which generates the sub-screenimage, as a preview image. If an action is sensed, the electronic devicemay operate a timer and capture a sub-screen image which is outputtedfrom an image sensor which generates the sub-screen image when the timerexpires. The electronic device may compose the captured main screenimage and sub-screen image, and process the composed image and store theprocessed image. The main screen may be a first screen, and the secondscreen may be a sub-screen.

In a method of photographing the main screen image and the sub-screenimage according to another embodiment of the present disclosure, first,an electronic device may capture the main-screen image which isoutputted from the image sensor which generates the main screen image,and may preview-display an image which is outputted from the imagesensor which generates the sub-screen image and operate a timer.Further, when the timer expires, the electronic device may capture asub-screen image which is outputted from a second image sensor whichgenerates the sub-screen image. The electronic device may compose themain screen image and the sub-screen image which are captured by thetimer, process the composed image, and store the processed imaged.

In the description below, it is assumed that the electronic deviceincludes a dual image sensor. Further, it is assumed that the dual imagesensor of the electronic device is mounted respectively on the rear sideof the electronic device and the front side where the display unit ismounted, and the front image sensor is positioned at the bezel area ofthe display unit. The image sensor, which is mounted on the rear side ofthe electronic device, may be a first camera which is mounted on thefirst side of the electronic device, and the front camera, which ismounted on the front side of the electronic device, may be a secondcamera which is mounted on the second side.

Further, the image sensor may include image sensors which arefunctionally connected by using a wireless connection such as a NearField Communication (NFC) and Wireless FIdelity (WIFI) as well as animage sensor which is connected to the terminal.

It is assumed that the electronic device according to an embodiment ofthe present disclosure includes a first image sensor, which is mountedon the rear side of the electronic device, and a second image sensor,which is mounted on the front side of the electronic device including adisplay unit. Further, in the preview mode of the dual photographicmode, the electronic device may display the image obtained from thefirst image sensor as the main screen, and display images obtained fromthe second image sensor as the sub-screen of the main screen. Theelectronic device may display the main screen image obtained from thefirst image sensor on the whole screen of the display unit, or partlydisplay the main screen image on the display unit. Further, in theelectronic device, the sub-screen image obtained from the second imagesensor may be displayed in the form of PIP of the main screen, or inparallel.

Further, when a photographic operation is requested in the preview mode,the electronic device may capture a first image of the main screen whichis obtained from the first image sensor, capture a second image of thesub-screen which is obtained from the second image sensor after a timeperiod elapses, and compose and store the first and second images. Thesequential photographic method may be set by the timer, or, if an actionis sensed after the main screen image is captured, the timer may beoperated, and when the timer expires, the sub-screen may beautomatically captured in the sequential photographic method.

FIG. 1 illustrates a configuration of an electronic device according toan embodiment of the present disclosure.

Referring to FIG. 1, a first image sensor 120 (rear image sensor) may bemounted on the rear side of the electronic device, and a second imagesensor 125 (front image sensor) may be mounted on a front side bezelarea of the electronic device. The first image sensor 120 may be animage sensor of higher pixel density than the pixel density of a secondimage sensor 125. The first image sensor 120 and the second image sensor125 may be independently operated under control of the controller 100,or may be simultaneously operated. Further, the first image sensor 120and the second image sensor 125 may photograph a still image or movingimage under control of the controller 100.

The controller 100 controls overall operation of the electronic device.Further, the controller 100 may operate, respectively or simultaneously,the first image sensor 120 and/or the second image sensor 125, displaythe images, which are photographed when simultaneously operated, as thedual screen of the main screen and the sub-screen, and photographing andediting of the dual screen.

The sub-screen may be a Picture In Picture (PIP) type. Further, thecontroller 100 may include a timer 113 and an action sensing unit 115,and when a photographic operation is requested in the preview mode, thecontroller 100 may photograph the main screen and the sub-screen imageswhile controlling the first image sensor 120 and the second image sensor125 by using the timer 113 and/or the action sensing unit 115, andcompose and store the photographed images.

The storage unit 110 may include a program memory which stores anoperating program of the electronic device and a program according to anembodiment of the present disclosure, and a data memory which storesphotographed images.

The display unit 130 may be mounted on the front side of the electronicdevice as in the second image sensor 125, and display the images whichare obtained from the first image sensor 120 and/or the second imagesensor 125 under control of the controller 100. The display unit 130 maybe configured with an LCD or an OLED. The input unit 140 may generateinputs for controlling a photographic mode of the electronic device. Thedisplay unit 130 and the input unit 140 may be formed as an integratedtouch screen.

The sensor 150 may include at least one sensor for sensing the state ofthe electronic device. The sensor may be a geomagnetic sensor, anacceleration sensor and/or a gyro sensor, and may generate a signal forsensing the change according to the rotation and/or the disposed stateof the electronic device and output the signal to the controller 100.

The controller 100 of the electronic device having the aboveconfiguration may obtain a plurality of images by simultaneouslyoperating (dual mode) the first image sensor 120 and the second imagesensor 125, and display the obtained image on the display unit 130 asthe main screen and the sub-screen. The controller 100 may change themain screen and the sub-screen according to the user's selection.Further, when a photographic operation is requested at the dual mode(dual shot), the electronic device may photograph by operating the firstimage sensor 120 and the second image sensor 125 according to an order,and compose the photographed main screen and sub-screen images togenerate one still image.

A dual image may be photographed by using the timer 113 and the actionsensing unit 115. If the user requests a photographic operation in thepreview mode, the controller 100 may capture the main screen image whichis outputted from the image sensor which generates the main screenimage, and preview-display the sub-screen image which is outputted fromthe image sensor which generates the sub-screen image. If the actionsensing unit 115 senses an action, the controller 100 operates the timer113, and, when the timer 113 expires, may capture the sub-screen imagewhich is outputted from the image sensor which generates the sub-screenimage. The electronic device may compose the captured main screen imageand sub-screen image, and process and store the composed image.

The main screen and sub-screen image may be photographed by using thetimer. In such a case, the controller 100 may capture the main-screenimage, which is outputted from the image sensor which generates the mainscreen image when a photographic operation is requested, preview-displaythe image, which is outputted from the image sensor which generates thesub-screen image, and operate the timer 113. Further, if the timer 113expires, the controller 100 may capture the sub-screen image which isoutputted from the second image sensor which generates the sub-screenimage. The controller 100 may compose the captured main screen image andsub-screen image, process and store the composed images.

FIGS. 2A to 2C illustrate a procedure of displaying and photographing adual image in an electronic device equipped with a dual image sensoraccording to an embodiment of the present disclosure. FIGS. 2A to 2Cshow an example of generating the main screen image in the first imagesensor 120 and generating the sub-screen image in the second imagesensor 125. However, the main screen image may be generated in thesecond image sensor 125 and the sub-screen image may be generated in thefirst image sensor 120 according to the user's selection.

Referring to FIGS. 2A to 2C, in the preview mode where the first imagesensor 120 and the second image sensor 125 are operated, the first imagesensor 120 photographs the first image (i.e., a scenery image) as inreference numeral 210, and the second image sensor 125 photographs thesecond image (i.e., an image of a photographer) as in reference numeral220. The controller 100 may display the first image 210, which isobtained from the first image sensor 120, as the main screen as in FIG.2B, and may display the second image 220, which is obtained from thesecond image sensor 125, as the sub-screen.

If a photographic operation is requested in the preview mode, theelectronic device according to an embodiment of the present disclosuremay photograph the main screen image and the sub-screen image as in FIG.2C.

Referring to FIG. 2C, if a photographic operation is requested in thepreview mode, as the operation in reference numeral 250, the controller100 may capture the main screen image, as in reference numeral 255,which is generated in the first image sensor 120 and operate the timeras in reference numeral 260. The controller 100 may display the capturedmain screen image on the display unit 130, display the preview image ofthe sub-screen as in reference numeral 277, and display operation of thetimer as in reference numeral 275. If the timer expires, the controller100 may capture the sub-screen image 277. In this case, the capturedimage may be an image as shown in reference numeral 280.

Here, FIGS. 2B and 2C illustrate an example where the second image 220,which is obtained from the second image sensor 125, is fixed on thelower left area of the display unit 130. However, if necessary, thedisplay area of the image, which is displayed as the sub-screen, may bevariably set. For example, the sub-screen display area may be displayedon the area adjacent to the image sensor (e.g., the second image sensor125). In the dual mode, the second image sensor 125 photographs theuser's image, and, in such a case, if the sub-screen display area is setat a position adjacent to the second image sensor 125, a naturalsub-screen image may be obtained.

That is, if the sub-screen display area is set at a position adjacent tothe second image sensor 125, the direction of photography (view angle)of the second image sensor 125 may be set to coincide with the user'seyes as much as possible, and thus a natural user's image may beobtained. Likewise, if the sub-screen image is displayed as describedabove, the controller 100 may capture the sub-screen image which isdisplayed in the preview mode when a photographic operation isrequested, and may move the captured sub-screen image to the sub-screenarea, which is the original sub-screen area when composing images, tocompose the image with the main screen image.

Alternatively, if a photographic operation is requested in the previewmode, as the operation in reference numeral 270, the controller 100 maycapture the main screen image from the second image sensor 125 and maycapture the sub-screen from the first image sensor 120.

FIG. 3 is a flowchart illustrating a procedure of photographing imagesin an electronic device equipped with a dual image sensor according toone embodiment of the present disclosure.

Referring to FIG. 3, if the operation of dual image sensor is requestedthrough the input unit 140, the controller 100 may perform the dualimage sensor mode at operation 311.

FIG. 4 is a flowchart illustrating a procedure of performing a previewmode in a dual mode according to an embodiment of the presentdisclosure.

Referring to FIG. 4, in the electronic device which operates the firstimage sensor 120 and the second image sensor 125, the controller 100 maydisplay an image sensor selection button and a dual button on thepreview screen at operation 411. The image sensor selection button is abutton for selecting an image sensor which photographs an image which isdisplayed as the main screen, and the dual button is a button forselecting a dual-on mode and a dual-off mode. The image sensor selectionbutton and the dual button may be a button which is operated in a toggletype.

If the first image sensor 120 is selected by the camera button, thecontroller 100 senses the selection of the first image sensor, and mayselect the first image sensor 120 as an image sensor for generating themain screen image at operation 413. Further, if the user touches thedual button in a state in which the first image sensor 120 is selected,the controller 100 senses the dual-on mode at operation 415, andoperates the second image sensor 125 at operation 417. The controller100 may process an image obtained from the first image sensor 120 anddisplay the processed image on the display unit 130 as the main screen,and process and resize the image obtained from the second image sensor125, and display the processed and resized image as the sub-screen on aposition of the display unit 130 at operation 417.

The controller 100 may already recognize the size and the displayedposition of the image which is displayed as the sub-screen, and thesub-screen may be displayed as overlay with a size at a position of themain screen. The display position and size of the sub-screen ispreviously set with a default display position and size, and the displayposition and/or display size may be changed according to user'sselection. However, if the dual mode is turned off (dual off) through adual button in a state in which the first image sensor 120 is selected,the controller 100 may sense the dual off at operation 415, and processan image obtained from the first image sensor 120 and display theprocessed image on the display unit 130 at operation 419. The operationof the second image sensor 125 may be a turned-off state.

Further, if the user selects the second image sensor 125 by using acamera button, the controller 100 may sense the selection of the secondimage sensor at operation 413, and may analyze the state of the dualbutton at operation 421. If the state is in a dual off state, thecontroller 100 may sense the dual off state at operation 421, andoperate the second image sensor 125 and turn off operation of the firstimage sensor 120 at operation 425. Further, the controller 100 mayprocess the image obtained from the second image sensor 125 and outputto the display unit 130. The operation of the first image sensor 120 maybe in an off state.

However, if the user touches the dual button in a state in which thesecond image sensor 125 has been selected as an image sensor whichgenerates the main screen image, the controller 100 senses the touch atoperation 421 and performs the dual mode by operating the first imagesensor 120 at operation 423. In this case, the controller 100 mayprocess an image obtained from the second image sensor 125 to displaythe processed image as the main screen on the display unit 130, andprocess and resize the image obtained from the first image sensor 120 todisplay as the sub-screen at a position of the display unit 130.

In the description below, it is assumed that the first image, which isgenerated in the first image sensor 120, is selected as the main screenimage, and the dual mode is in a turned-on state. Further, it is assumedthat, in the photographic mode, first, the first image, which is themain screen image, is captured, and the second image, which is thesub-screen image, is captured. However, when a photographic operation isrequested, first, the electronic device may capture the sub-screenimage, and may capture the main screen image.

Referring to FIG. 3 again, in the preview mode of the dual image sensor,the controller 100 may process the first image outputted from the firstimage sensor 120 to display the processed image as the main screen onthe display unit 130, and process the second image photographed in thesecond image sensor 125 to display the processed image on the displayarea of the sub-screen. The controller 100 may include an image signalprocessor, and the image signal processor may include an imagepre-processing unit, an image post-processing unit, an image scaler, aCodec, and the like. In such a case, the first image outputted from thefirst image sensor 120 may be pre-processed and post-processed in theimage signal processor, and may be scaled with the main screen size ofthe display unit 130 by the image scaler and outputted. Further, thesecond image, which is outputted from the second image sensor 125, maybe pre-processed and post-processed in the image signal processor, andmay be scaled with the sub-screen size by the image scaler andoutputted.

If a photography request occurs in the preview mode, the controller 100may capture the first image outputted from the first image sensor 120and the second image which is photographed in the second image sensor125, and compose the captured images and store the composed images inthe storage unit 110. Generally, when a dual shot is photographed byusing a dual image sensor, the user sets the main screen image suitableto the photographic frame, and in such a case, the photographic frame ofthe sub-screen image may not be desirable. In such a case, thesequential photographic method may be used. According to the sequentialphotographic method, the main screen image may be first set with adesired photographic frame to photograph, and the sub-screen image maybe set with a desired photographic frame to photograph. Further, in thesequential photographic mode, the controller 100 may display on thedisplay unit 130 that the currently displayed main screen and sub-screenare photographed.

If a photography request from the user occurs while performing a previewmode, the controller 100 may sense the photography request at operation313, process and capture the first image generated in the first imagesensor 120 and process the second image generated in the second imagesensor 125 to display the processed images as the preview image on thedisplay unit 130 at operation 315. The controller 100 may display on thedisplay unit 130 the first image of the main screen as a still image andthe second image of the sub-screen as the preview image.

The controller 100 may examine occurrence of an action. The action is aninput for capturing the second image, and may be an action which ispreviously set in the setting mode or is set at the time of deliveringproducts. The action may include a touch, a gesture, and the like. Forexample, the action may be a location rotation of device, a shaking orswing, a motion detection, a brightness change (e.g., an illuminationsensor touch or covering), a shutter switch on, a screen hovering, ascreen touch, and the like. Further, the action may be set as the user'saction, and in such a case, the action may be a blink, a smile, and thelike. In the sequential photographic mode of the dual image sensor, theuser may register a certain action among the above actions in thesetting mode. Further, the action may be sensed through the sensor 150,the input unit 140 and/or the second image sensor 125, and the actionsensing unit 115 may sense occurrence of the action sensing signal.

If the action occurs after capturing the first image, the controller 100may sense the occurrence of the action through the action sensing unit115 at operation 317, and operate the timer at operation 319. Further,while the timer 113 is operating, the controller 100 may display thefirst image as a still image on the display unit 130, and display thesecond image generated in the second image sensor 125 as the previewimage at operation 321. The timer may provide time for setting the frameof the second image which is intended to be captured through the secondimage sensor 125 after the user captures the mains screen image.

If the timer 113 expires, the controller 100 may sense the expiration ofthe timer at operation 323 and capture the second image at operation325. The second image may be a sub-screen image. The main screen imagehas been captured as a still image, and the main screen may be displayedas a still image. The controller 100 may compose the captured secondimage with the sub-screen area of the first image, and encode thecomposed image and store the composed image in the storage unit 110 atoperation 327.

Further, if the controller 100 does not sense the photography request atoperation 313, and if the request for terminating the operation of theimage sensor occurs in the preview mode, the controller 100 may sensethe request for terminating at operation 331 and terminate the operationof the dual image sensor at operation 333.

FIG. 5 is a flowchart illustrating an example of photographing a dualimage in an electronic device equipped with a dual image sensoraccording to an embodiment of the present disclosure. FIG. 5 illustratesa case where the action is a rotation (shaking) of the electronicdevice.

FIG. 6 illustrates a procedure of photographing a dual image as in FIG.5 according to an embodiment of the present disclosure.

Referring to FIGS. 5 and 6, the controller 100 performs the preview modeat operations 511 to 515, and may capture the first image 610 anddisplay the second image 620 as the preview image as shown in referencenumeral 630 of FIG. 6 when photographic operation is requested in thepreview mode. The controller 100 may control the electronic device, atoperations 511, 513 and 515, in the same manner as operations 311, 313and 315 of FIG. 3. The action for capturing the second image is set tothe rotation (or shaking) of the electronic device. After the firstimage is captured, if the user rotates the electronic device as inreference numeral 640 of FIG. 6, the sensor 150 may generate therotation sensing signal of the electronic device to apply the sensingsignal to the controller 100, and the action sensing unit 115 of thecontroller 100 may sense the rotation of the electronic device atoperation 517.

The rotation of the electronic device may include rotation, shakingand/or swinging. The user needs time for setting the frame of thedesired second image after rotating the electronic device. If therotation of the electronic device is sensed at operation 517, thecontroller 100 may operate the timer 113 as in reference numeral 650 ofFIG. 6 at operation 519. The timer 113 may guarantee a time required forsetting the second image to a desired frame after the user rotates theelectronic device.

If the timer 113 is operated at operation 519, the controller 100 maydisplay operation of the timer 113 on the display unit 130 as inreference numeral 665 as shown in reference numeral 660 of FIG. 6, andif the timer 113 expires, the controller 100 may capture the secondimage and compose the first image and the second image and store thecomposed image while performing operations 521, 523, 525 and 527. Theoperation may be performed in the same manner as the operations 321,323, 325 and 327 of FIG. 3. The controller 100 may control theelectronic device, at operations 531 and 533, in the same manner asoperations 331 and 333 of FIG. 3.

FIG. 7 is a flowchart illustrating a procedure of sequentiallyphotographing a dual image in a device equipped with a dual image sensoraccording to another embodiment of the present disclosure.

Referring to FIG. 7, when a dual image sensor is operated, thecontroller 100 may perform a preview mode of the dual image sensor atoperation 711. If the user requests a photographic operation in thepreview mode, the controller 100 may sense the request at operation 713,capture the first image at operation 715, and display the second imageas the preview image. The operations 711, 713 and 715 may be performedin the same manner as the operations 311, 313 and 315 of FIG. 3.

After capturing the first image, the controller 100 may operate thefirst timer to capture the second image at operation 717, and examinewhether an action is sensed at operation 719. That is, after operatingthe first timer, if an action is sensed before the timer expires, thecontroller 100 may capture the second image. The actions may be aninteraction (for example, hovering or a touch interaction method, andsharing, rotating, swinging, and motion detecting, and the like of theelectronic device).

If the first timer is being operated and an action is not sensed, thecontroller 100 may sense this situation at operation 731 and display thecaptured first image as the still image of the main screen at operation733, and may preview the second image, which is photographed in thesecond image sensor 125, as a preview image on the sub-screen displayarea. The first timer, which is operated in the above operation 717, mayprovide time for setting the frame of the second image which is to becaptured through the second image sensor 125 after the user captures themains screen image.

However, after the first timer is operated, if the first timer expiresin a state in which an action is not sensed, the controller 100 maysense the expiration of the first timer at operation 731 and capture thesecond image at operation 727. The second image may become a sub-screenimage. The main screen image has been captured as a still image, andthus the main screen may be displayed as a still image.

However, if an action is sensed before the first timer expires, thecontroller 100 may sense the action at operation 719 and operate thesecond timer at operation 721. The second timer, which is operated inthe above operation 721, provides time for setting the frame of thesecond image, which is intended to be captured through the second imagesensor 125, after the user performs an action. The period of the secondtimer may be set to the same period as that of the first timer, or maybe set to have a different period. Further, the controller 100 mayprocess the captured first image as a still image to be displayed as themain screen, and display the second image obtained from the second imagesensor 125 as a preview image on the sub-screen display area until thesecond timer expires at operation 723. Further, if the second timerexpires, the controller 100 may sense the expiration of second timer atoperation 725 and capture the second image at operation 727.

After the second image is captured in the above operation 727, thecontroller 100 may compose the first image and the second image, encodethe composed image, and store the encoded image in the storage unit 111at operation 729, and may return to the above operation 711 to perform apreview mode. Further, if a termination of the image sensor is requestedin the preview mode, the controller 100 senses the request at operation741 and turns off the dual mode at operation 743.

It was assumed, in the description of FIGS. 3 to 7, that the first imagegenerated in the first image sensor 120 is the main screen image, andthe second image generated in the second image sensor 125 is asub-screen image. However, the second image generated in the secondimage sensor 125 may be selected as the main screen image, and the firstimage generated in the first image sensor 120 may be selected as thesub-screen image. Further, in the description of FIGS. 3 to 7, it wasassumed that, in the sequential photographic mode, the sub-screen imageis captured when the timer expires after the main screen image iscaptured, but, on the contrary to this, the sub-screen image may befirst captured, and the main screen image may be captured when the timerexpires.

FIG. 8 illustrates a configuration of a portable terminal which performsa photographic operation according to an embodiment of the presentdisclosure. The portable terminal may include a mobile phone including asmart phone, an MP3 terminal, a tablet personal computer, and a portableor wearable computer, and the like.

Referring to FIG. 8, the communication unit 170 may perform a wirelesscommunication function with a base station or an Internet server. Thecommunication unit 170 may include a transmission unit which up-convertsthe frequency of a transmitted signal and amplifies power, and areception unit which low-noise-amplifies the received signal anddown-converts the frequency. Further, the communication unit 170 mayinclude a modulation unit and a demodulation unit. The modulation unitmodulates a transmitted signal and transmits the modulated signal to thetransmission unit, and the demodulation unit may demodulate a signalreceived through the reception unit. The modulation and demodulationunit may be an LTE, WCDMA, GSM, and the like or Wi-Fi, WIBRO, NFC,Bluetooth, and the like. It is assumed, in the various embodiments ofthe present disclosure, that the communication unit 170 is equipped withLTE, Wi-Fi, and Bluetooth communication units.

The first image sensor 120 may photograph an image of a high resolutionby the rear image sensor which is mounted on the rear side of theterminal device. The second image sensor 125 is a front image sensorwhich is mounted on the front side of the terminal device, and mayphotograph an image of a low resolution which is relatively lower thanthe first image sensor 120.

The controller 100 may control overall operation of the portableterminal, and may include an Application Processor (AP) 810 forcontrolling the process of various applications of the portableterminal, and a Communication Processor (CP) 820 for controlling thecommunication function of the portable terminal. Further, theapplication processing unit 810 includes a timer 113 and an actionsensing unit 115, and controls to display the first image and the secondimage as the main screen image and the sub-screen image in the previewmode of the dual mode, and photograph the first image and the secondimage by using the timer 113 and the action sensing unit 115 in thecapturing mode, and compose and store the images.

The storage unit 110 may include an operation program of a terminal anda program memory for storing a program according to an embodiment of thepresent disclosure, and a data memory for storing tables for operationof the terminal and data which is generated while performing a program.

The display unit 130 may display information on the application which isbeing executed under control of the controller 100. Further, the displayunit 130 may display images of the main screen and the sub-screen undercontrol of the controller 100 in the dual mode. The display unit 130 maybe configured with an LCD or an OLED. The input unit 140 may beimplemented in a capacitive type or a resistive type, and output thelocation information of the user's touch (it is assumed that the touchis a finger touch) to the controller 100. Further, the input unit 140may further include an EMR sensor pad, and may sense a pen touch inputand output the pen touch input to the controller 100. The display unit130 and the input unit 140 may be integrally formed.

The sensor 150 may include sensors for sensing movement of the portableterminal. The sensors may include an acceleration sensor, a geomagneticsensor, a gyro sensor and/or a location sensing sensor. The audioprocessing unit 180 may process a voice signal which is generated in thecommunication mode under control of the controller 100.

The controller 100 of the portable terminal 100 may include a camerabutton for selecting an image sensor for displaying as the main screenimage on the display unit 130, and a dual button for turning on/off thedual mode setting. Further, when the user's dual button is turned on,the controller 100 performs a dual mode for operating the first imagesensor 120 and the second image sensor 125, and in the dual mode, thecontroller 100 may display the images outputted from the image sensors120 and 125 as the dual image of the main screen and the sub-screen onthe display unit 130. Further, the controller 100 may select the imagesensor which outputs the main screen image by selection of the imagesensor selection button in the dual mode. According to an embodiment ofthe present disclosure, it is assumed that, when the portable terminalis operated in a dual mode, the first image sensor 120 is selected asthe main screen image sensor and the second image sensor 125 is selectedas the sub-screen image sensor.

When the dual image sensor of the portable terminal is operated, in thepreview mode, the controller 100 may display the first image generatedin the first image sensor 120 as the main screen, and display the secondimage generated in the second image sensor 125 as the sub-screen. Theapplication processing unit 810 of the controller 100 may include atimer 113 and an action sensing unit 115, and may photograph the firstimage and the second image by using the timer 113 and the action sensingunit 115 when photography is requested.

The method of photographing the main screen image and the sub-screenimage according to one embodiment of the present disclosure will bedescribed. When a photographic operation is requested, the controller100 may photograph the main screen image and the sub-screen image whileperforming a procedure as in FIG. 3. That is, when a photographicoperation is requested in the preview mode, first, the controller 100may capture the main screen image which is outputted from the imagesensor which generates the main screen image, and preview-display thesub-screen image which is outputted from the image sensor whichgenerates the sub-screen image. The controller 100 may examine whetheran action for capturing the second image is generated through the actionsensing unit 115.

The action may be previously set, and be generated through the sensor150, the second image sensor 125 and/or the input unit 140 which is atouch panel. If the action is an action that detects the movement(rotation, swinging, or shaking) of the electronic device, the actionsensing unit 115 may sense occurrence of the action through the sensor150. Further, if the action is the user's facial expression (e.g., ablink, a smile, etc.), the action sensing unit 115 may sense occurrenceof the action through the second image sensor 125. Further, if theaction is a gesture or a touch interaction on the display unit 130, theaction sensing unit 115 may sense the occurrence of the action throughthe input unit 140.

If an action is sensed by the action sensing unit 115, the controller100 operates the timer 113, and if the timer expires, the controller 100may capture the sub-screen image which is outputted from the imagesensor which generates the sub-screen image. The controller 100 maycompose the captured main screen image and sub-screen image, and processand store the composed image.

Further, the method of photographing the main screen image and thesub-screen image according to anther embodiment of the presentdisclosure will be described. The controller 100 may photograph the mainscreen image and the sub-screen image while performing a procedure as inFIG. 7. The timer 113 may include a first timer and a second timer.First, if a photographic operation is requested in the preview mode, thecontroller 100 may capture the main screen image outputted from theimage sensor which generates the main screen image, preview-display theimage outputted from the image sensor which generates the sub-screenscreen image, and operate the first timer.

If an action is not sensed until the first timer expires, the controller100 may capture the sub-screen image outputted from the second imagesensor, compose the captured main screen image and sub-screen image, andprocess and store the composed image. However, if an action is sensed inthe action sensing unit 115 before the first timer expires, thecontroller 100 operates the second timer, and if the second timerexpires, the controller 100 may capture a sub-screen image which isoutputted from the image sensor which generates the sub-screen image.The controller 100 may compose the captured main screen image andsub-screen image, and process and store the composed image. The periodof the first timer may be identical with or different from the period ofthe second timer. Further, the action may be the same as the action ofthe above described one embodiment.

According to the present disclosure, images, which are recognizedthrough at least one image sensor, may be captured, and the capturedimages may be stored as a main screen or a sub-screen. A plurality ofimages may be obtained by one photography command by automaticallyphotographing the sub-screen image by operating the timer afterphotographing the main screen image, and a plurality of natural imagesdesired by the user may be obtained when photographed by the timer.Further, for example, when a sequential photographic mode is set, if anaction is sensed after photographing the main-screen image by thephotography request, the sub-screen image may be photographed when atime period is elapsed, and thus it is possible to obtain the sub-screenimage of a desired form after photographing the main-screen image.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. A mobile communication device comprising: aplurality of image sensors including a first image sensor and a secondimage sensor; a touchscreen display; a processor adapted to: display atleast one portion of a first image in a first area of the touchscreendisplay, as a first preview image, and at least one portion of a secondimage in a second area of the touchscreen display, as a second previewimage, the first image being obtained using the first image sensor inreal time, the second image being obtained using the second image sensorin real time, both the first preview image and the second preview imagebeing displayed together; generate a first still image from the firstimage sensor, in response to a user input; and display at least oneportion of the first still image in the first area while displaying thesecond preview image in the second area, wherein the display of the atleast one portion of the first still image replaces the display of thefirst preview image while the second preview image is displayed, thedisplay of the at least one portion of the first still image occupyingthe first area of the touchscreen display previously occupied by thefirst preview image.
 2. The mobile communication device of claim 1,wherein the first image sensor is mounted on a same side of the mobilecommunication device as the touchscreen display.
 3. The mobilecommunication device of claim 1, wherein the processor is furtheradapted to: receive, via the touchscreen display, another user input tooperate the first and second image sensors, prior to the displaying ofthe first and second preview images.
 4. The mobile communication deviceof claim 1, wherein the first area is positioned closer to the firstimage sensor than the second area.
 5. The mobile communication device ofclaim 1, wherein the processor is further adapted to change position andsize of the first and second areas, in response to another user input.6. The mobile communication device of claim 1, wherein the first area isseparated from the second area, and positioned in proximity of thesecond area.
 7. The mobile communication device of claim 1, wherein theat least one portion of the first image is generated by scaling orsubsampling of the first image.
 8. The mobile communication device ofclaim 1, wherein the first still image is generated using the firstpreview image.
 9. The mobile communication device of claim 1, whereinthe processor is further adapted to: after the at least one portion ofthe first still image and the second preview image is displayed,generate a second still image from the second image sensor, in responseto another user input.
 10. The mobile communication device of claim 9,wherein the processor is further adapted to: display at least oneportion of the second still image in the second area while displayingthe at least one portion of the first still image in the first area. 11.The mobile communication device of claim 9, wherein the processor isfurther adapted to: generate a third image by combining the at least oneportion of the first still image and at least one portion of the secondstill image.
 12. The mobile communication device of claim 11, whereinthe processor is further adapted to: display the third image via thetouchscreen display.
 13. The mobile communication device of claim 11,wherein the processor is further adapted to: store the third image tomemory operatively coupled with the mobile communication device.
 14. Amethod of processing an image using a mobile communication device, themethod comprising: displaying at least one portion of a first image in afirst area of the touchscreen display, as a first preview image, and atleast one portion of a second image in a second area of the touchscreendisplay, as a second preview image, the first image being obtained usingthe first image sensor in real time, the second image being obtainedusing the second image sensor in real time, both the first preview imageand the second preview image being displayed together; generating afirst still image from the first image sensor, in response to a firstuser input; and displaying at least one portion of the first still imagein the first area while displaying the second preview image in thesecond area, wherein the displaying of the at least one portion of thefirst still image replaces the display of the first preview image whilethe second preview image is displayed, the display of the at least oneportion of the first still image occupying the first area of thetouchscreen display previously occupied by the first preview image. 15.The method of claim 14, further comprising: receiving, via thetouchscreen display, another user input to operate the first and secondimage sensors, prior to the displaying of the first and second previewimages.
 16. The method of claim 14, further comprising: generating asecond still image from the second image sensor, in response to anotheruser input.
 17. The method of claim 16, further comprising: displayingat least one portion of the second still image in the second area whiledisplaying the at least one portion of the first still image in thefirst area.
 18. The method of claim 16, further comprising: generating athird image by combining the at least one portion of the first stillimage and at least one portion of the second still image; and displayingthe third image via the touchscreen display.
 19. The method of claim 16,further comprising: generating a third image by combining the at leastone portion of the first still image and at least one portion of thesecond still image; and storing the third image to memory operativelycoupled with the mobile communication device.
 20. A non-transitorymachine-readable storage device storing instructions that, when executedby one or more processors, cause the one or more processors to performoperations comprising: displaying at least one portion of a first imagein a first area of the touchscreen display, as a first preview image,and at least one portion of a second image in a second area of thetouchscreen display, as a second preview image, the first image beingobtained using the first image sensor in real time, the second imagebeing obtained using the second image sensor in real time, both thefirst preview image and the second preview image being displayedtogether; generating a first still image from the first image sensor, inresponse to a first user input; and displaying at least one portion ofthe first still image in the first area while displaying the secondpreview image in the second area, wherein the display of the at leastone portion of the first still image replaces the display of the firstpreview image while the second preview image is displayed, the displayof the at least one portion of the first still image occupying the firstarea of the touchscreen display previously occupied by the first previewimage.